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Abstract 

A vision chip in which photo detectors (FD) and processing elements (PE) are directly connected in each pixel 
and are integrated on a single chip solves the bottleneck problem at the input stage but the bottleneck at the 
output stage still exists. To solve the problem, in this paper, we propose an architecture for extracting moments as 
outputs especially targetting vision chips consisting of digital circuits. Also we present some examples of moments 
calcuration and evaluate the architecture at the point of speed and implementation. 



Key words vision chip, visual feedback, I/O bottleneck, moment, VLSI 



1 (iUK>^3 

^■/^f A^8»Ltt*^^*o (PD) 
(PE) 7 > *" y ^ 

/hffl, o#^-f ^ 

ifufforfts^JS^T^^o ccd 

(30Hz) JaTUS0K3*tTv»*:^ Vf >'3 >*~y 1kHz 

VLSI ^CD*«Uov»-c^#lR"r^o 

2 *»rae<DWft 

Mead hiz*&i'>) ^>mm^mm^^[ih w*>> 

f 7 i ^ t f ^ ^SF«%^ ^ /jo 1*^ 

?fr*m^X^ 1ms [3], VJto94 A 

*fR*i&* v X y- JU [4] . 1ms &yt&& v * 7" * [5] 

^?n/vT 0 ^n.^^^^.*^ A±."ctjf^-J" & £ * 

^^vaVf-yr^T-^f^f^ S 3 PE **S*L*: 

[7] 0 fBir-^T-^^^uisv^-c, # PE <i#««ojM5iR 

n^^^^W^^ y hzs'JTJl'lZff&o ALU t 24(4-2) 
i£^co PE tS«$nTv»4o SIMD MCO^^'J^^^" 



*> *K vtf-yh Mm tt t*cr> T -7 ') *r - •> 3 >• K t ^£b*C-£> 
iCH^Htt^o 0.8 /xm CMOS 
rtrStf^-f* ^"XMi. PE *3 WffifS** 240^mx240Mm 
■C. 8x8 S*rt««*S£*l.t:v>£o £ 0.35/im CMOS 

150^mxl50Mm "C, 16x16 MSWJSfR £ *LT ^ ^ 

>J»o 77>Xtli, Programmable Artificial Retina t 

pe ii3 t'^ho^'i &m<o8tmmn*:$ktrt 

Z> 0 itz. 65 x 76 gf^fv^m^^tv^, 
ry ^ — > -C td , Near-Sensor Image Processing (NSIP) 

$*UTV*& [10] o #PE (i 8 V: v b co> ^ 'J 

Ig(iit:7^7" K NAND sftSfcJB^TfT* 9 o 
32x32 M*^^"y^ 1 l85&**i-"Cv^o 

jtimt [10] -C^^^ixXV^T^^^JUtf^a >-f~ y /(i, 
ftltffftiifc^tSi ( N 2 fiMi^) o S 3 PE e 

m^fr^isd t-r^^^-^ii. mioi^t: pe ti^ 



Photo Detector Procos»«(n9 Element 




Output 



Digital Vision Chip Extraction 

Circuit 



3 IS It Si" 

^asiamiBiKtc^* e ixz><&n t lt\ *-r#— c 
e ->* a >^ * ■/ s 3 pe tuu alu k tr y ^v , ;r Jt 

*t vlsi u^^-r ^ ^ t ses • 

L< , ffcfcftKiS©:^ < Li do ^S^^fcT^g 

£\ &mmm^&ft;<*i-£&mm^:nmm'tri±, o(n) 

^3>f--yy-e(i, GLU tt&tffi&fiS^ — ;is&m^*T 
4.1 ^^c?>ffifi£ 



SI 2 tZff?^^^-fe 




row{n- 1 ) 

colO coll col(n-0 

m 2 ^&(om$L 
t ju&mmwu (bsca) 3d*(b*>), ^-sa#^<i pe com 

fa ^ It H -i" o fT«§#DSE|* SB l±^|6] U la^U i^^^ S ^ 
4.2 i^^>^©:g5 



elk 
i 



OFF 





FULL 






ADDER * 











out 



data 



SI 3 fcf > K *> V T^&atfmJMi (BSCA) 



BSCA ^jg^JH TV 



19)— 



(0 o 




(4) 0 







g| 4 (N=4,m=2) : 11 + 10 4- 01 + 00 

0110 



II^SIO AND **UtU MWWK8BKUi;&-r*«fle 

co^gtc— /cfi^^'J 3r§2BL. *x 

n iitn^ i/-^ 9/* <Dtz#><D?--y -?wm-t> s 

^ - > *■ *fef£-r & =r - ? * KB i" £ £> * o 

Stl^-T X 7 KcmWM x ttzit y <0 LSB frh (a + 1) 



una 



a=0 



a=l 



a=2 



BSCA coAzfcf in l±«K 0 U^Sx £ *t~C^ S 0 
# BSCA OUvX^ti 0 ?'JT LT*5 <- 0 (1) & 
BSCA CQUvX^G U-fc* bSttSo # PE frh<Of- 
*05*Tffi^ ^ > (LSB) ri* BSCA COA^J data 
<btl*t* & BSCA O^JnULS^fnt^rYU-Sr-ttW-r 
So BSCA coA^J in Kfi£iS$*L£o m ©SE-ft 

ciot, bsca <o^iraJMiiifflfc** u-fcwtt 

M$ii.jfc^e*raW»»=f5^^^^^* &fn<^ LSB 7&*t 
« BSCA Oout ^^tfS*$n-5o — *\ * BSCA co^: 
SQ#S<o*-v } ) -titfJli elk «-S-Oj£*>Jb&*9 tuy7 9 
Ktt4rt$*u hJa^ifefpfl-Jt^tt^^So (2) & 

v*-T, PE ii*h<0^- 9<D LSB tf* 2 f SOlfy h 
^ data teftO LSB ^ 2#BOtfy h 

BSCA CD out ri*e>iB;&S*L&o # BSCA O^Jfllf 

So Z<D9 ^9it^tX<D^-9 ( m hfctS) 
$fLSit?«k 0«$^*o (3) (4) ^-^*^T«$tL/:« 
<i, ^S+log 2 ((2 m -l)AT) tf-y h (*»j£«J ») ii*f > 

4.3 fr/?iJ*i3fe$B 

■*-&«*-f£iS-*-*o &«tt#te***tfcort: PE 



fit-. ^^^i^ffiv^TPE F^-e?m©:^fir^o^^^> 

iJttS PE f*3^~ ^) o 

aiitsBo^ o -y ^*^-r 9 ^a-e^L. pe fst-co^m^ 

L/j75 f o T , 0 > > h moo fi:*^^ "7 tC^^il 



m 00 = 52 



log 2 -t-^^^log 2 (iV 2 (M-l))-(2n + 

AT N 

m L0 = ^ ^ y) (3) 

A* AT 

moi = y^y^y^g.y) ( 4 ) 

*U* J: U><£»T% Iog 2 (JV 2 (7V - l)(Af - l)/2) - (3tx + m) 
X< * feT y Fa^-^id AND ^^SgRC^t^ffi 



x = x„2 rt ~ 1 4- x„_i2 n " 2 -H ... + x t 2° 

A r AT 

X=l y=l 

Jt=l x-l y=l 

-7 ( AND dfc-C, s* fi log a (iV 2 (M - l)/2) 

- (2n + m- 1) * n -y ^ -9- -f ^ ;u -Cft# £ *l * 0 L7tA*o 

^^T^ftK^a, ^It^n -y ^JU?aiin(2n+m-l) 
t&£ 0 Iftf-^^'ftU-ASft^ (Af=2) 

^MCftflJSSjfcfflSKiiiiT- fc -C, Jog 2 (A 2 (A r - l)/2) ^ 
(3n"i)^D7^0 ;u-r- i ^c^- * > h j SrWJ¥i--s 

m 01 fcpjfficz LT*«6^fL«»o 



-60 

AT AT 

m 2 o = 

x = l y=l 
TV AT 

x = l y— J 

PE *^»«I6St»oTU>KI^ log 2 (A 72 (A^-l)(2A r - 
l)(Af - l)/6) - (4n + m- l) ^ a -y ? ^ ^ ^ ^Tlfff £ 

*l*o -5-5 -eiitfi^ isxzfy? <d tr -y 

t L"Cfflv^ 2^2og 2 (A^ 2 (M - 1)) - 2n(2n + m)) 
>;<Ofc tti, log 2 AT 2 (A r - 1)(2/V- l)/6 ~ {4tx- 1) ^ 



/fe = l 1 3C=l J/^l 

n n. 
n 

= 53 2*-^* (9) 

PE^*JH»*6«r«FoTt^tt^ log 2 (A r2 (A-l) 2 (A/- 
l)/4) -(4n + m- 2) ^ n v ^ "9" 'f ^ ^X'ft^ ^ *l* c 
PE **lfe#«fig4:i*/c*v^*-Ct. h'*?->\z£ 
^•7^ ^ -C ^fjfe/ U log 2 (7V 2 (Af - 1)) - (2n + m) ^ o y 

U^^^^> t "Cftff ^tL^> 0 -g-If ? a v ^ 

5 fc (± iog 2 (AT2(,v- i)/2) - (3ti - 1) -cftJt$*t. :n 

n t-C mji it n(3n- 1)^07^0 

;v -eft©: S & o 

6 vlsi mmzmr zmm 

&m-t%T-*T?^Xlzm^£. HDL U^As&HU 1 

^ tis«s«ifftd f at 2 nm^nmnm^ s±Nm<n v v 



HQ : (A) PB ^^^ig^^o^^r (B) PE 
v> 0 ; y- o -y y*m9f± 2.0ATns £-f2> 0 







(A) 


(B) 


0 ^ - > y h moo 






(/V= 64, Af=64) 


18(2.3^s) 


18(2-3^s) 


(iV'=256, Af=64) 


22(ll/xs) 


22(1X^3) 


(A'^256, M= 2) 


16(B.2ms) 


16<S.2ms) 








(7V= 64, A/=64) 


25(3.2^*3) 


102(13*xs) 


(/V=256, A/=64) 


29(l5^s) 


168(86^s) 


(AT=256, Af- 2) 


23(12fis) 


23(12fi 9 ) 


2 — > > f" 77X TO ,»Tl02 






64, A/=64) 


29(3.7^s) 


< 216(28^3) 


(.^=256, W=64) 


37(l9/is) 


< 352(18Gfxs) 


(AT = 2S6, M— 2) 


3l(l6^is) 


3l(16/is) 


2 — > > b mai 






(N= 64 , M=64) 


28(3.6/xs) 


< 648(83pts) 


(W=256, M^64) 


36(18^) 


< 14O8(720j*s) 


(JV^256, M = 2) 


30(1 5^s) 


184(94^s) 



N ^(D&m^'^^-CfrZo PE frfz*) <OiI#0 h =7 >^>*^ ? 

£fc»± TV-* "C 38 -C^>*?. Ctili S 3 PE t'^a 

co b 7 >V7s?%L<D 10% JSlT"C*5o '^-Ml ISfSiO* 

c^finJ¥«fr«v»* i t-c, pe ^/c^oii^ah^^ 
&^»&f»igM$-s>Tv»*<*>-<N VLSI — <o 

<f;:*MS& Ins fciR5£T£c:. fl^a-^raii 2Nns 
ttcho 0.35 /xm CMOS yD-t^^y^^^ 
/-> < ^ lx- >< 3 >"Cii x o v £ JgjJHti: 1.2iVns "C 

■r*/ W XiJj; t^yXrA <t L T OSfMK * ^ f£T-fr & *? ft 
[1] C. Mead and M. Mahowald, t: A SiJicon Model of 



Early Visual Processing", Neural Network, Vol.1, 
pp. 91-97, Jul., 1988. 

[2j Masatoshi Ishika\va T Akira Morita, and Nobuo 
Taka^'anagi, £i High Speed Vision System Using 
Massively Parallel Processing", Proc. IROS , 92, 
pp.373-377, 1992. 

(3] *«F»«, EJIIjEffc : t&mm • M7%&^ *>*3 

jfcutf? h^^m, Vol.15, No.3, pp.417-421, 1997. 
[4] *!&m$l, S/UiE 

Vol.J81-D-n, No.5, pp.918-924, 1998. 

[6] Idaku Ishii, Yoshihiro Nakabo, and Masatoshi 
Ishikawa: Target Tracking Algorithm for 1ms Vi- 
sual Feedback System Using Massively Parallel 
Processing, Proc. IEEE Int. Conf. Robotics and 
Automation, pp.2309-2314, 1996. 

[7] /h£3£, ^*f^v>, ^JIIJE^: iam^n-lr y 

-> > cr^ u jl > y t-fflv^cffiife^J * tf ->* 3 > 

v ■^OKtt', ^-rttfaiSM^^f«^:^, Vol.J81-D-I, 
No.2, pp.70-76, 1998. 

[8] Masatoshi Ishikawa, Kazuya Ogawa, Takashi Ko- 
muro, and Idaku Ishii: A CMOS Vision Chip with 
SIMD Processing Element Array for 1ms Image 
Processing, 1999 IEEE Int. Solid-State Circuits 
Conf. (ISSCC'99) Dig. Tech. Papers, pp:206-207, 
1999. 

[9] Thierry M. Bernard, Bert rand Y. Zavidovique 
and Francis J. Devos, **A Programmable Artifi- 
cial Retina", IEEE Journal of Solid-State Circuits, 
Vol.28, No.7, pp.789-797, 1993. 

[10] Jan-Erik Eklund, Christer Svensson and Anders 
Astrom, "VLSI Implementation of a Focal Plane 
Image Processor ~ A Realization of the Near- Sensor 
Image Processing Concept", IEEE Trans. VLSI 
Systems, Vol.4, No.3, pp.322-335, 1996. 

[11] f£j#*lj^, ^JIIjOE, "Hfe^iJtT^a >cO*:fr<D 2« 

mmm&®&", voi.92, 

No.329, pp.11 1-116, 1992. 
[12] d^#, HiHiE^, "fcT* hyu-^M 

^, PRMU ffiltg; (to be appeared), 1999. 



t 107-0052 5fcJHfiB?BK*5M£ 9-6-41 7>*«t^ 5*%9fftft8*^ 

TEL : 03-3475-5618 FAX : 03-3475-5619 E-mail: kkmmori@msh.biglobe.ne.jp 

Copyright Clearance Center, Inc. 

222 Rosewood Drive. Danvers, MA 0)923 USA 

Phone:978-750-8400 FAX : 978-750-4744 www.copyrighi.com 



Notice about photocopying 

In order to photocopy any work from this publication, you or your organization must obtain permission 
from the following organization which, has been delegated Tor copyright for clearance by the copyright 
owner of this publication- 
Except in the USA 

Japan Academic Association Tor Copyright Clearance (JAACC) 
41-6 Akasaka 9-chome, Minato-ku, Tokyo 107-0052 Japan 

TEL: +81-3-3475*5618 FAX: +81-3-3475-5619 E-mail: kammori@m5h.biglobe.ne.jp 
In the USA 

Copyright Clearance Center. Inc. (CCC) 

222 Rosewood Drive, Danvers. MA 01923 USA 

Phone: +1-978-750-8400 FAX: + 1-978-750-4744 URL: hrtp ://www.copy right xom 



m^f#$gj&fei t£3z&mm$zm^ m^&m vol 9 9 no. 1 s 2 

1999^7^16 &mn 

IEICE Technical Report 

Copyright ; © 19?9 by the Institute of Electronics, Information 
and Communication Engineers (IEICE) 

«ita xk*k#kx;£h 3tb 5*8-9- ^mmmr^n^ 
ftnm m%\%m\K^<&ffi 3Ti5t 8t 

|^ «^««a«*^ W:m C03) 3433-6691 

Mi£1&^am 00120-0-S53O0 

The Institute of Electronics, Information and Communication Engineers, 
Kikai-Shinko-Kaikan Bldg., 5 — 8, Shibakoen 3 chome, Minato — ku 
TOKYO, 105-0011 JAPAN 

Copyright and reproduction permission : All rights are reserved 
and no part of this publication may be reproduced or transmitted 
in any form or by any means, electronic or mechanical, including 
photocopy, recording, or any information storage and retrieval system, 
without permission in writing from the publisher. Notwithstanding, 
instructors are permitted to . photocopy isolated articles for 
noncommercial classroom use without fee. 



(B|.2 00002 40 15 1 



Hr m 



mm&ttwmm^ n^mmmm^^mmm^m^ prmu9 9 . 

Ulto 



12^ 1^ 140 



^mm^n^^m 1571 3 2 

Sill jE« 
m^fP^C^ES LUSTS 1 3i7^ 




'Jv 




5 



T@4f 3f 




(B)20000240157 
llllllllllllilllllllllllll 

m m hie m 



5 /II IE ^ IS 

Kmm.ffi'& ffl i $2 i s 



t ^ ^ ^ <g) 

&> f < ^ 53t ^ i 



(B)20000240157 

iiniiii 



w-mi 1^12^1 3B 

Sill lEm It 

vtm.mmn eb#h mm is 

ffiFfi if. »MjP -XJ^&'t^ /-27 SV 1 



5u 1K ^dx^tJE M £ 



*j#2 000 — 010180 



ai m a m m m m 



(5 9 6 0 94 74 0] 
1 . ^M^B 0 1 9 9 6^ 6|28H 

ft ffi fMttf*il5 7 1#i0 3 2 



1 



ffi§E# 2000-3104237 



#2 O 0 0 — 0 10 18 0 



m m a m m m m 



~ (3 9 00 09 6 67) 

1 . B 1 9 9 3lfll| 10 

2. U^HB 2 0 0 0^ 7M 6 0 



2 



2000-3104237 



